Sonification of Facial Actions for Musical Expression
نویسندگان
چکیده
The central role of the face in social interaction and non-verbal communication suggest we explore facial action as a means of musical expression. This paper presents the design, implementation, and preliminary studies of a novel system utilizing face detection and optic flow algorithms to associate facial movements with sound synthesis in a topographically specific fashion. We report on our experience with various gesture-to-sound mappings and applications, and describe our preliminary experiments at musical performance using the system.
منابع مشابه
Online Map Interface for Creative and Interactive
In this paper, we discuss the musical potential of COMPath an online map based music-making tool as a novel and unique interface for interactive music composition and performance. COMPath provides an intuitive environment for creative music making by sonification of georeferenced data. Users can generate musical events with simple and familiar actions on an online map interface; a set of local ...
متن کاملCreating tangible spatial-musical images from physical performance gestures
Electroacoustic music has a longstanding relationship with gesture and space. This paper marks the start of a project investigating acousmatic spatial imagery, real gestural behaviour and ultimately the formation of tangible acousmatic images. These concepts are explored experimentally using motion tracking in a source-sound recording context, interactive parameter-mapping sonification in three...
متن کاملData-to-music Api: Real-time Data-agnostic Sonification with Musical Structure Models
In sonification methodologies that aim to represent the underlying data accurately, musical or artistic approaches are often dismissed as being not transparent, likely to distort the data, not generalizable, or not reusable for different data types. Scientific applications for sonification have been, therefore, hesitant to use approaches guided by artistic aesthetics and musical expressivity. A...
متن کاملThe AIMS Project: Creative Experiments in Musical Sonification
The Applications in Musical Sonification (AIMS) project is dedicated to creative experiments in musical sonification. It studies sonification in the context of algorithmic composition, focusing on the design and implementation of these experiments in software. An initial distribution of cross-platform, open-source software is now freely available that implements some basic mappings, including h...
متن کاملSynthesis of human facial expressions based on the distribution of elastic force applied by control points
Facial expressions play an essential role in delivering emotions. Thus facial expression synthesis gain interests in many fields such as computer vision and graphics. Facial actions are generated by contraction and relaxation of the muscles innervated by facial nerves. The combination of those muscle motions is numerous. therefore, facial expressions are often person specific. But in general, f...
متن کامل